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ABSTRACT 

Training  costs  have  increased  in  the  U.S.  Navy.  This  study  examines  accession 
data  to  determine  if  the  following  events  caused  training  costs  to  rise;  length  of  basic 
training,  attrition,  and  amount  of  specialized  training.  The  examination  of  these  issues 
is  restricted  to  three  enlisted  ratings,  AT,  AW,  and  AX.  The  time  frame  encompasses 
year  group's  77  through  84.  On  the  basis  of  this  limited  study,  there  is  no  reason  to 
associate  these  three  variables  with  increased  costs. 
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I.  INTRODUCTION 

The  U.S.  Navy  spends  over  2  billion  dollars  a  year  on  training.  Training  costs 
are  rising,  but  the  Navy  does  not  have  a  clear  understanding  of  why.  A  multitude  of 
factors  affect  cost,  however,  we  do  not  know  what  those  factors  are.  To  understand 
this  problem,  let  us  develop  a  general  concept  to  work  from.   (See  Figure  1.1.) 


S 

A 

B 

S  = 

the  set  of  all  events  that  have  the  power  to 
affect  training  costs 

A  = 

{events  that  have  occured}                            «-  factors 

B  = 

{events  that  have  not  occured} 

S  = 

(A  U  B)                                                  0  =  (A  n  B) 

Figure  1.1     The  concept. 

Let  us  identify  events  that  have  the  power  to  affect  training  costs.  We  will  call 
this  set  S.  Secondly,  let  us  divide  the  set  S  into  two  mutually  exclusive  sets  A  and  B. 
Let  A  be  the  set  of  all  events  that  have  occured  and  B  be  the  set  of  all  events  that  have 
not  occured.  Our  goal  is  to  find  events  that  belong  to  set  A.  Set  A  will  be  labeled 
factors  since  by  definition,  a  factor  is  a  contributing  clement  that  brings  about  a  given 
result.    In  our  case,  the  end  result  is  rising  training  costs. 

A.       PROBLEM  STATEMENT 

Why  is  the  cost  of  training  rising?  To  answer  this  question,  we  divided  the 
problem  into  several  subproblems.  We  selected  three  subproblems  to  be  research 
questions  for  this  study. 


•  Has  the  length  of  basic  training  increased*. 

•  Has  attrition  increased. 

•  Has  the  amount  of  specialized  training  increased! 

Our  goal  is  to  identify  events  that  affect  training  costs.    Imbedded  within  our 
problem  statment  are  three  events.   These  events  are: 

A.  The  length  of  basic  training  has  increased. 

B.  Attrition  has  increased. 

C.  The  amount  of  specialized  training  has  increased. 

Can  we  classify  any  of  these  events  as  factors!  Or  stated  differently,  "Have  any  of 
these  events  occured?"  If  event  A,  B,  or  C  occured,  then  at  least  one  reason  will  exist 
to  explain  the  rise  in  training  cost. 

B.       OBJECTIVES 

This  study  attempts  to  answer  three  questions.    Let  us  transform  those  questions 
into  statistical  hypotheses. 


HQ:   The  length  of  basic  training  not  has  increased. 
H,:   The  length  of  basic  training  has  increased. 


FL:   Attrition  has  not  increased. 
H,:   Attrition  has  increased. 


H0:   The  amount  of  specialized  training  has  not  increased. 
Hji   The  amount  of  specialized  training  has  increased. 


These  three  hypotheses  form  the  basis  of  this  study.  Statistical  methods  will  answer 
these  questions  by  either  accepting  or  rejecting  the  null  hypothesis.  The  objectives  of 
this  thesis  are: 

1.  Test  all  three  hypotheses. 

2.  Accept  or  reject  each  event  as  a  factor  that  increases  cost. 
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II.  HISTORY  AND  BACKGROUND 

The  Chief  of  Naval  Operartions  (CNO)  expected  training  costs  to  fall  when 
retention  increased  in  the  early  19S0's.  However,  a  decrease  did  not  occur.  The  Center 
for  Naval  Analyses  (CNA)  was  tasked  to  examine  the  relationships  between  training 
costs  and  retention.  CNA  formulated  some  general  reasons  why  training  costs  might 
change.  They  set  out  to  confirm  those  reasons  by  using  information  stored  in  their 
historical  data  files.  From  those  data  files,  they  provided  a  small  data  base  for  this 
study. 

A.       DATA  BASE  DESCRIPTION 

The  Navy  has  101  enlisted  rating  codes.  CNA's  data  set  contains  information  on 
every  enlisted  rating.  The  data  base  used  for  this  study  contains  information  on  only 
three  enlisted  ratings.   These  ratings  are: 

AT     =  Aviation  Technician 

AW    =  Aviation  Anti-Submarine  Warfare  Operator 

AX  =  Aviation  Anti-Submarine  Warfare  Technician 
We  selected  these  ratings  for  the  following  reasons.  This  author,  in  conjuction  with 
CNA,  expressed  an  interest  to  examine  the  aviation  community.  Next,  we  decided  to 
observe  two  closely  related  technical  ratings  from  a  squadron's  maintenance 
department,  so  we  selected  the  AT's  and  AX's.  Lastly,  we  wanted  to  observe  a  rating 
from  the  squadron's  operations  department,  so  we  selected  the  AW's. 

The  second  point  that  characterizes  this  data  base  is  that  it  is  a  selected  sample 
from  the  three  ratings.  Given  the  record  has  a  rating  code  of  'AT',  AW',  or  'AX',  the 
second  screening  criteria  consists  of  all  records  that  are  coded 
'SG  =  School  Guarantee'.  We  will  say  more  about  this  criteria  in  the  next  section. 
Figure  2.1  provides  a  Venn  diagram  concerning  the  selection  process  for  records  that 
entered  this  study's  data  base.  Corliss  [Ref.  1]  describes  the  original  data  set.  See 
Appendix  B  for  a  detailed  layout  of  this  data  base. 
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CNA's  Data  Set 

CD 

A  =  (AT  U  AW  U  AX) 
Data  Base  =  (A  n   B) 

B  = 

=  (SG) 

Figure  2.1     Record  selection  process. 

B.       EXPECTED  TRAINING  PATH 

For  the  first  enlistment  period,  an  individual's  expected  career  path  follows  that 
which  is  portrayed  in  Figure  2.2.  An  individual  receives  indoctrination  at  Recruit 
Training  Command  (RTC).  This  command  is  commonly  known  as  Boot  Camp.  The 
recruit  proceeds  to  A-school  upon  completion  of  Boot  Camp.  A-school  provides  the 
recruit  initial  skills.  Upon  completion  of  A-school,  the  individual  advances  to  the  fleet. 
The  individual  will  receive  more  school  based  training  from  C-schools  and  F-schools, 
while  serving  productively  in  the  fleet.  C-schools  and  F-schools  provide  an  individual 
with  advanced  skills  and  fleet  skills  respectively. 

Let  us  return  back  to  the  data  base  selection  criteria.  A  'School  Guarantee'  is  a 
clause  written  in  the  recruit's  enlistment  contract  that  assures  the  recruit  will  proceed 
directly  to  A-school  upon  completion  of  Boot  Camp.  Without  the  'School  Guarantee', 
a  recruit  may  be  sent  directly  to  the  fleet  from  Boot  Camp.  This  study  is  strictly 
concerned  with  individuals  who  follow  the  expected  training  pipeline  as  depicted  in 
Figure  2.2. 
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EXPECTED  CAREER  PATH 

Boot  Camp 

A-School 

*  Fleet  * 

i 

i 
Training  Period                                   Productive  Period 

*    While  serving  in  the  fleet,  a  person  will  receive  training  from 
C-Schools  and  E-Schools. 

Figure  2.2     First-term  enlistment  milestones. 

C.  LIMITATIONS 

As  discussed  earlier,  the  Navy  has  101  enlisted  ratings.  However,  the  data  base 
used  to  support  this  study  has  only  three  enlisted  ratings.  Secondly,  these  individuals 
are  selected,  not  random.  Thirdly,  we  are  observing  the  performance  oC  each  group 
over  time.  The  time  frame  is  dependent  upon  the  rating  we  are  observing.  The  time 
frames  available  for  study  are: 

AT  81     82     83     84 

AW      77    78    79     80     81     82     83     84 

AX  81     82     S3     84 

The  reason  for  the  differences  in  time  frames  is  due  to  the  fact  that  prior  to   1981, 
school  guarantees  were  not  given  out  to  individuals  desiring  the  AT  or  AX  ratings. 

D.  SCOPE 

The  scope  of  this  study  is  restricted  to  the  first  enlistment  period.  (See  Figure 
2.3.)  The  following  subsections  describe  the  measures  used  in  the  analysis.  Limitations 
and  definitions  are  listed  to  set  the  foundation  for  each  hypothesis  test. 

1.   Length  of  Basic  Training 

The  data  base  does  not  provide  us  with  a  way  to  calculate  the  exact  time  a 
person  spends  in  basic  training,  however  we  have  another  measure.  This  measure  is 
called  'time  to  get  rated'.  (See  Figure  2.4.)  For  each  individual,  we  have  two  dates. 
These  dates  are  defined  as  follows: 
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ENLISTMENT  PERIODS 


1st 

2nd 

3rd 

1 1 1 1 

PEBD 


EAOS 


EAOS- 


EAOS- 


PEBD  =  PAY  ENTRY  BASE  DATE 

EAOS  =  END  OF  ACTIVE  OBLIGATED  SERVICE 


Figure  2.3     Enlistment  Periods. 

•  PEBD  =  (Pay  Entry  Base  Date)  This  is  the  date  a  person  enters  the  Navy.    This 
date  is  used  for  accounting  purposes. 

•  RD   =   (Rating  Date)  This  is  the  date  a  person  is  designated  into  one  of  the 
Navy's  occupational  specialties. 


training  period 


productive  period 


PEBD  RD 

PEBD  =  Pay  Entry  Base  Date 
RD        =  Rating  Date 
EAOS  =  End  of  Active  Obligated  Service 


EAOS 


Figure  2.4     Initial  Training  Period. 

A  person  gets  rated  upon  completion  of  A-School  or  shortly  thereafter.  As  seen  in 
Figure  2.4,  time  to  get  rated  is  defined  as  the  difference  between  a  person's  rating  date 
and  pay  entry  base  date.  Time  to  get  rated  will  be  used  to  measure  the  length  of  basic 
training. 
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As  outlined  in  Figure  2.3,  this  study  is  restricted  to  the  first  enlistment  period. 
This  time  frame  is  normally  48  months.  The  first  half  of  the  enlistment  period  is 
defined  as  the  Basic  Training  period.  Using  this  definition,  our  study  of  basic  training 
will  be  restricted  to  the  first  24  months  of  the  enlistment  period.   (See  Figure  2.5.) 


BASIC  TRAINING  TIME  CONSTRAINT 

(months) 

c 

1st  enlistment  period 

i                         i                         i 

1 

1                                  !                                 1 

>                      12                      24                      36 

4S 

— » 

1  «- 

ATTRITION  TIME  CONSTRAINT 

(months) 

N(t)  =  number  of  survivors 

* 

J. 

* 

( 

# 

)                      12                      24                      36 

48 

— ► 

1  «— 

Analysis  will  be  performed  within  the  time  constraint  denoted  by: 


Figure  2.5     Time  constraint. 
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2.  Attrition 

Percent  losses  and  attrition  rates  are  the  measures  used  to  compare  year 
groups.  Given  a  year  group,  percent  loss  is  defined  as  the  number  of  individuals  that 
leave  the  Navy  divided  by  the  number  of  individuals  that  enlisted  in  the  Navy. 
Attrition  rate  is  defined  as  the  number  of  individuals  that  leave  the  Navy  per  month. 
We  restrict  our  analysis  to  the  first  24  months  per  year  group.  Our  goal  is  to  measure 
attrition  in  the  training  environment  and  not  in  the  operational  environment.  (See 
Figure  2.5.) 

3.  Amount  of  specialized  training 

The  Navy's  C-schools  provide  individuals  with  advanced/specialized  skills. 
Upon  completion  of  a  C-school  course,  the  individual  receives  a  Naval  Enlisted 
Classification  (NEC)  code.  NEC  codes  supplement  the  enlisted  rating  structure  by 
identifying  particular  skills  in  more  detail  than  the  occupational  or  rating  structure. 
The  navai  terminology  is  simply  this: 

•  RATING  =  individual's  occupational  specialty 

•  NEC       =  individual's  occupational  subspecialty 

As  an  example,  see  Table  I.  Joe  Sailor's  occupational  specialty  is  Aviation 
Technician.   Joe  Sailor's  occupational  subspecialty  is:1 

-  Aircraft  Radar  Altimeter  IMA  Technician 

-  Aircraft  Doppler  Radar  IMA  Technician 

-  Aircraft  Navigation  Computers  IMA  Technician 

In  general,  his  occupation  deals  with  aircraft  navigation  systems. 

We  measured  the  amount  of  specialized  training  a  year  group  received  by  the 
number  of  NECs  received.  This  measurement  took  place  during  the  second  and  third 
year  of  service.   (See  Figure  2.6.) 

The  reasons  we  defined  the  second  and  third  year  of  service  as  the  window  for 
analysis  are  threefold.  One,  if  an  individual  follows  the  expected  training  pipeline,  the 
first  year  is  spent  in  Boot  camp  and  A-school.  Since  the  individual  is  not  enrolled  in 
C-school  during  the  first  year,  the  expected  number  of  NEC's  earned  will  be  zero. 
Two,  if  we  use  the  entire  time  period  spanned  by  the  data  base,  year  group  7S  will  have 
had  more  time  to  aquire  NEC  codes  than  year  group  SO.    We  need  to  ensure  each  year 


The  Naval  Aviation  Maintenance  Program  has  three  levels  of  maintenance.  The 
levels  are  operational,  intermediate,  and  depot.  IMA  is  known  as  intermediate  level 
maintenance. 
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TABLE  I 

JOE  SAILOR'S  RATING  AND  NEC  CODES 

RATING 

DESCRIPTION 

AT 

Aviation  Technician 

NEC 

DESCRIPTION 

6605 

Aircraft  Radar  Altimeter  IMA  Technician 

6606 

Aircraft  Doppler  Radar  IMA  Technician 

6608 

Aircraft  Navigation  Computer  IMA  Technician 

YG77 

YG  78 

YG  79 

1        1 

YG  80 

1        1        1 

YG  81 

11~         78  79  80  SI  82  83  S4         ~~85 

YEAR 
Boxes  represent  the  time  frame  a  year  group  will  be  under  examination 


Figure  2.6     NEC  Analysis  Time  Frames. 
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group  has  exactly  the  same  time  length  and  the  same  time  period  in  their  respective 
careers  to  accumulate  NEC  codes.  Three,  we  stated  earlier  that  our  analysis  will  be 
restricted  to  the  first  enlistment  period. 
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III.  METHODOLOGY  AND  ANALYSIS 

A.       BASIC  TRAINING 

1.  Time  to  get  rated:    Is  there  a  trend? 

Has  the  time  to  get  rated  changed  over  time?    To  answer  this  question,  we 
define  the  Two  Factor  Analysis  of  Variance  (ANOVA)  model  as  follows: 


78 

79 

80 

81 

82 

83 

84 

AT 

AW 

Yijk 

AX 

MODEL 


:   Yijk  =  p.  +  Pj  +  tj  +  (Px)^  +  cijk 


INDICES:  i     =  rating 

j     =  year  group 

k    =  k     individual  from  group  (i,j) 

=  number  of  months  the  k     individual  from  group  (i,j)  took  to  get  rated 

=  overall  average  time  to  get  rated  (grand  mean) 

=  additional  time  it  takes  an  individual  from  rating  i  to  get  rated 

=  additional  time  it  takes  an  individual  from  year  group  j  to  get  rated 

=  interaction  term 

=  error  terms  that  arc  iid   N(0,ff  ) 


Yijk 

Pi 

(Pt) 


'J 


C: 


ijk 

The  goal  is  to  test  the  t  vector.  Is  the  mean  time  to  get  rated  from  one  year 
group  statistically  dilferent  from  another?  We  answer  this  question  by  using  a 
statistical  test.   The  hypothesis  test  and  decision  rule  arc  listed  in  Table  II. 
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TABLE  II 

TWO  FACTOR  ANOVA  HYPOTHESIS  TEST 

H0: 

T77 

= 

T84 

Hr 

T77 

*    .  . 

•     *T84 

H0: 

The  mean  time  to  get  rated  has  remained 

constant. 

Ht: 

Not  all  th 

c  means  are  equal. 

IFF 

:;  < 

F(.95, 

7,  2690)  then  conclude  HQ 

If  F 

•:  > 

F(.95, 

7,  2690)  then  conclude  H, 

The  other  terms  in  the  model,  \i,  p,  and  (Pi),  are  considered  nuisance  factors. 
Our  goal  is  to  account  for  their  effects  and  block  out  their  contribution.  This  prevents 
the  estimate  of  <7"  from  being  inflated.  The  main  goal  is  to  test  for  differences  among 
year  groups. 

Table  III  lists  the  results  of  the  test.  All  main  factors  are  significant.  Look  at 
the  table  results  concerning  the  t  vector.  It  is  statistically  significant  at  the  .0001  level. 
It  is  highly  unlikely  that  the  %'s  arc  equal.  The  P  value  (.0001)  supports  the  alternate 
hypothesis,  not  all  the  means  are  the  equal.  Using  our  decision  rule,  since  F*  >  F,  we 
accept  the  alternate  hypothesis  and  conclude  a  trend  exists.  "The  time  to  get  rated  has 
changed  over  the  years." 

Figure  3.1  is  a  scatter  plot  of  the  entire  population.  A  couple  of  interesting 
things  arc  worth  noting. 

•  Outliers  are  located  above  the  mean,  none  below. 

»    On  the  average,  Year  Group  84  took  the  least  amount  of  time  to  get  rated. 

•  The  dispersion  about  the  population  means  is  smallest  within  Year  Group  84. 
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Notice  the  presence  of  outliers  on  the  high  side  but  none  on  the  low  side.  As 
expected,  there  is  some  minimum  time  required  to  get  rated  but  no  upper  bound.  We 
will  truncate  all  values  of  Y  greater  than  24  months  in  the  ensuing  analysis.  The 
reasons  are  threefold.  One,  as  stated  in  the  original  set  of  objectives,  the  focus  on 
Basic  Training  will  be  restricted  to  the  first  two  years  of  service.  Two,  a  set  of  unusual 
circumstances  caused  these  individuals  to  take  a  substantial  amount  of  time  to  get 
rated.  They  have  detoured  from  the  expected  training  pipeline  and  we  are  not 
interested  in  these  individuals.  Three,  truncating  the  outliers  will  stabilize  the  variance 
for  future  ANOVA  tests.  Only  25  data  points  will  be  lost.  This  amounts  to  .009  or 
.9%  of  the  observations.   Censoring  these  data  points  should  not  affect  future  tests. 

Now,  let  us  look  at  1984.  Tables  IV  and  V  display  Tukey's  pairwise 
comparisons  for  all  year  groups.  All  pairwise  comparisons  with  year  group  S4  are 
statistically  significant.  Since  the  average  time  to  get  rated  by  Year  Group  84  is  least 
among  all  other  year  groups,  we  will  delete  that  group  from  the  ensuing  analysis.  No 
further  analysis  need  be  done  to  that  year  group. 

In  summary,  this  first  test  establishes  a  trend.  The  time  to  get  rated  has 
changed  over  the  years.  Secondly,  the  time  to  get  rated  has  decreased  from  19S3  to 
1984.    Let  us  investigate  what  happened  prior  to  1984. 

2.  Has  the  time  to  get  rated  increased  or  decreased  through  1983? 

The  first  test  revealed  the  presence  of  a  trend.  The  test  also  pointed  out  that 
the  time  to  get  rated  decreased  from  1983  to  1984  for  all  groups.  To  see  what 
happened  prior  to  1984,  we  will  test  each  group  separately.  We  will  follow  the 
methodology  used  in  Neter,  Wasserman,  and  Kutner  [Ref.  2:  Sec.  17.2].  The  objectives 
are: 

8    Estimate  the  mean  time  to  get  rated  for  each  year  group. 

•  Test  the  means  for  statistical  difference. 

•  Rank  the  means  using  a  paired  comparison  test. 

Our  analytical  tool  to  test  the  means  for  statistical  differences  is  the  Single  F'actor 
ANOVA  Model.  The  Kruskal-Wallis  (KW)  nonparamctric  test  for  equal  means  will  be 
used  as  a  backup  test.  Then,  given  the  means  arc  different,  Tukey's  paired  comparison 
test  will  be  used  to  examine  the  nature  of  the  differences.  Based  on  the  paired 
comparison  test  results,  we  will  rank  the  means. 
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Figure  3.1     Time  to  get  rated. 
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TABLE  III 

TIME  TO  GET  RATED 
TWO  FACTOR  AXOVA  RESULTS 

CLASS 

LEVELS 

VALUES 

P 

3 

AT  AW  AX 

T 

8 

77  78  79  80  81  82  83  84 

s 

df 

SS 

MS 

F* 

PR>F* 

Model 

15 

7310.0331 

487.3355 

34.51 

0.0001 

Error 

2690 

37984.2551 

14.1205 

Total 

2705 

45294.2882 

S 

df 

SS 

MS 

p* 

PR>F* 

P 

2 

247.7304 

123.8652 

8.77 

0.0002 

T 

7 

2844.0842 

406.2977 

28.77 

0.0001 

Pr 

6 

160.8890 

26.8148 

1.90 

0.0774 

R2 

C.V. 

VMSE 

my 

0.1614 

23.1616 

3.7577 

16.2239 

F(.95,7,l 

!690)  =  2.01 

23 


TABLE  IV 

TIME  TO  GET  RATED 

i 

TUKEY'S  PAIRED  COMPARISON  TEST  RESULTS  A 

• 

i 

77 

nj          |i  +  x{ 

70       17.214 

78 

102       15.029 

79 

165       13.709 

80 

213       15.357 

81 

442       15.971 

82 

967       16.219 

83 

687       17.868 

84 

60       10.217 

G,j) 

CIlb 

T-  -  T- 
1        J 

CIub 

SIG 

84-83 

-9.185 

-7.651 

-6.116 

84-82 

-7.519 

-6.003 

-4.4S6 

.».  .'.  .•- 

84-81 

-7.322 

-5.754 

-4.1S6 

84-80 

-6.806 

-5.140 

-3.474 

-I"  •'.'•  f,' 

84-79 

-5.211 

-3.492 

-1.774 

84-78 

-6.667 

-4.813 

-2.958 

y.  >'.  -•- 

84-77 

-9.003 

-6.998 

-4.992 

•I'  -!*  *I* 

83-84 

6.116 

7.651 

9.185 

»•*  .*j  j«; 

83-82 

1.0S0 

1.64S 

2.217 

:■.:  :■.:  * 

83-81 

1.202 

1.897 

2.592 

:;-. .-;- :;-. 

83-80 

1.617 

2.511 

3.405 

.;-.  >:-.  * 

83-79 

3.170 

4.158 

5.147 

$  :-.:  :•: 

83-78 

1.629 

2.838 

4.048 

* .-;:  * 

83-77 

-0.777 

0.653 

2.083 

82-84 

4.4S6 

6.003 

7.519 

.*.  J.  4. 

S2-83 

-2.217 

-1.648 

-1.080 

^.  ...  .v 

82-81 

-0.406 

0.249 

0.903 

82-80 

-0.000 

0.862 

1.725 

82-79 

1.550 

2.510 

3.470 

# :;-.  * 

82-78 

0.003 

1.190 

2.376 

82-77 

-2.406 

-0.995 

0.416 

81-S4 

4.186 

5.754 

7.322 

.'.   -J.   ;.'. 

81-S3 

-2.592 

-1.897 

-1.202 

81-82 

-0.903 

-0.249 

0.406 

81-80 

-0.337 

0.614 

1.565 

81-79 

1.222 

2.261 

3.301 

•!- :!» ■*.' 

81-78 

-0.311 

0.941 

2.193 

81-77 

-2.710 
a 

.05 

-1.244 
df            MSE 

0.223 

2690          14.1205 

Comparisons 

signifies 

int  at  the 

0.05  level  are  indicated  by  '***' 

Critical  value 

of  stuck 

:ntized  range  =  q(.95;  7,  2683 

)  =  4.290 

Tukey's  pairc 

d  compt 

irison  con 

fidence  interval:    D 

±  Ts(D) 

D  =  (ji  +  tj 

)  -  (|l 

+  tj)     T 

=  (1/V2)q      s2(D) 

=  Kl/n,)  + 

(l/n|)]MSE 
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TABLE  V 

TIME  TO  GET  RATED 

TUKEY'S  PAIRED  COMPARISON  TEST  RESULTS  B 

i 

77 

nj           n  +  tj 

70       17.214 

78 

102       15.029 

79 

165       13.709 

80 

213        15.357 

81 

442       15.971 

82 

967       16.219 

83 

687       17.868 

84 

60       10.217 

(i,j) 

CIlb 

T-  -  T- 
1        J 

5.140 

CIub              SIG 

80-84 

3.474 

6.806              *** 

80-83 

-3.405 

-2.511 

-1.617              *** 

80-82 

-1.725 

-0.862 

0.000 

80-81 

-1.565 

-0.614 

0.337 

80-79 

0.466 

1.648 

2.830             *** 

80-7S 

-1.045 

0.327 

1.700 

SO-77 

-3.428 

-1.857 

-0.287              *** 

79-84 

1.774 

3.492 

5.211              *** 

79-83 

-5.147 

-4.158 

-3.170              *** 

79-82 

-3.470 

-2.510 

-1.550              *** 

79-81 

-3.301 

-2.261 

-1.222              *** 

79-80 

-2.830 

-1.648 

-0.466              *** 

79-78 

-2.756 

-1.320 

0.115 

79-77 

-5.131 

-3.505 

-1.879              *** 

78-84 

2.958 

4.813 

6.667              *** 

78-83 

-4.048 

-2.838 

-1.629              *** 

78  82 

-2.376 

-1.190 

-0.003              *** 

78-81 

-2.193 

-0.941 

0.311 

78-80 

-1.700 

-0.327 

1.045 

78-79 

-0.115 

1.320 

2.756 

78-77 

-3.954 

-2.185 

-0.416              *** 

77-84 

4.992 

6.99S 

9.003              *** 

77-83 

-2.083 

-0.653 

0.777 

77-82 

-0.4 1 6 

0.995 

2.406 

77-81 

-0.223 

1.244 

2.710 

77-80 

0.287 

1.857 

3.428              *** 

77-79 

1.879 

3.505 

5.131               *** 

77-78 

0.416 
a 

.05 

2.185 
df            MSE 

3.954              *** 

2690          14.1205 

Comparisons  s 

ignific 

ant  at  the 

0.05  level  are  indical 

:ed  by 

Critical  value  c 

f  stud 

entized  range  =  q(.95;  7,  2683 

)  =  4.290 

Tukcy's  paired 

comp 

arison  con 

fidence  interval:    D 

±  Ts(D) 

D  -   (|l  +    T-) 

"  (|l 

+   Tj)       T 

=  (l/72)q      s2(D) 

=  [(1/nj)  +  (1/dj)]MSE 
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77 


78 


79 


80 


SI 


82 


83 


AW 


Y" 


MODEL:    Y 


ij 


H  +  Tj 


'ij 


INDICES: 


i  =  year  group 
:th 


Yii 


j  =  j      individual  from  year  group  i 
=  number  of  months  the  j      individual  from  rating  i  took  to  get  rated 
=  overall  average  time  to  get  rated 

=  additional  time  it  takes  an  individual  from  year  group  i  to  get  rated 
=  error  terms  that  are  iid   N(0,cr2) 


The  hypothesis  test  and  decision  rules  associated  with  the  Analysis  of 
Variance  model  and  the  Kruskal-Wallis  nonparametric  test  are  listed  in  Table  VI. 

Test  results,  tables,  and  figures  that  support  this  discussion  are  grouped 
together.   They  are  laid  out  in  the  following  manner. 

AT  Figure  3.2        Data  Analysis  Graphs 

Table  VII         ANOVA/KW  test  results 

Figure  3.3        Tukey's  paired  comparison  test  results 

AW         Figure  3.4        Data  Analysis  Graphs 

Table  VIII       ANOVA/KW  test  results 

Figure  3.5         Tukey's  paired  comparison  test  results 

AX  Figure  3.8         Data  Analysis  Graphs 

Table  IX  ANOVA/KW  test  results 

Figure  3.9        Tukey's  paired  comparison  test  results 

Figures  3.2,  3.4,  and  3.S  provide  a  graphical  summary  of  the  data  sets.  Tables  VII, 
VIII,  and  IX  provide  the  ANOVA  test  results  and  the  Kruskal-Wallis  test  results. 
Figures  3.3,  3.5,  and  3.9  provide  Tukey's  paired  comparison  test  results.  These  figures 
display  a  graphical  ranking  of  the  means  and  a  confidence  interval  for  the  difference  in 
means.    Specific  results  arc  listed  in  the  figures  and  tables.    We  summarize  our  findings. 


26 


TABLE  VI 

SINGLE  FACTOR  ANOVA  HYPOTHESIS  TEST  #1 

HQ: 

T77            *  •  '           T83 

Hr 

T77    X     •  •  •    *  T83 

HQ: 

The  mean  time  to  get  rated  has 

remained 

constant. 

Hr 

Not  all  the  means  are  equal. 

-ANOVA- 

If  F: 

*  <  F(.95,  vp  v2)  then  conclude 

Ho 

IfF: 

::  >  F(.95,  Vj,  v2)  then  conclude 

H, 

-KW- 

If  X2KW  ^  X2(-95,  v)  then  conclude  HQ 

IfX2KW  >  X2(-95,  v)  then  conclude 

Hl 

For  all  three  ratings,  the  Analysis  of  Variance  test  and  the  Kruskal-Wallis  test 
results  were  highly  significant.  The  probability  that  the  means  are  equal  is 
almost  zero.  In  all  three  cases  we  reject  the  null  hypothesis  and  accept  the 
alternate  hypothesis.  We  conclude:  "The  mean  time  to  get  rated  has  changed  over 
the  years." 

For  the  AT  selectees,  the  time  to  get  rated  is  best  described  as  no  dilTcrcnce 
between  year  groups  81  and  82.  However,  year  group  83  took  an  extra  1.5 
months  to  get  rated.   There  is  a  slight  upward  trend. 

For  the  AW  selectees,  the  time  to  get  rated  is  best  described  as  cyclic.  The  mean 
time  to  get  rated  is  highest  in  1977.  Over  the  next  two  years,  the  mean  time  to 
get  rated  drops  to  its  lowest  in  1979.  After  1979,  the  trend  is  upwards  for  the 
next  4  years. 
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•    For  the  AX  selectees,  the  trend  is  U  shaped.    The  mean  time  to  get  rated  drops 
in  1982  and  rises  in  1983. 

B.       ATTRITION 

Has  attrition  increased  over  the  years?  If  the  answer  is  yes,  then  attrition  is  a 
factor  causing  training  costs  to  rise.  A  simple  relationship  exists  between  attrition  and 
training  costs.  If  the  attrition  rate  is  high,  then  the  Navy  must  train  more  people  to 
fulfill  quotas.    Increasing  the  number  of  people  to  be  trained  raises  the  training  cost. 

Two  methods  are  used  to  answer  the  question.  The  first  method  uses  the  actual 
percent  losses.  The  annual  percent  losses  are  inputs  into  the  Cox  and  Stuart 
nonparamctric  test.  The  test  determines  whether  an  increasing  trend  exists.  The 
second  method  uses  a  regression  approach.  Attrition  rates  are  estimated  using  a 
nonlinear  regression  model.  These  rates  serve  as  inputs  into  a  simple  linear  regression 
model. 

1.  Percent  Losses:   Is  it  rising? 


78 

79 

80 

81 

82 

83 

S4 

Boot  Camp 

pij 

A-school 

P-j       =  percent  loss  from  school  i  and  year  group  j 

=  number  of  individuals   that  left  the  Navy   from  group  (i,j)  divided   by  the 
number  of  individuals  that  started  in  group  (i,j) 

Percent  losses  were  calculated  twice,  once  for  Boot  Camp  and  once  for 
A-school.  We  examined  the  sequence  of  numbers  for  an  upward  trend  by  using  the 
Cox  and  Stuart  nonparamctric  test.  Conover  [Ref.  3:  p.  133]  outlines  the  test 
procedures  in  detail. 
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Figure  3.3     AT:    Tukey's  paired  comparison  test  results  #1. 
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Cox  and  Stuart's  test  is  designed  to  detect  trends  in  a  sequential  data  set.  Let 
Xj,  .  .  .  ,  Xn  be  a  sequence  of  random  variables.   The  test  procedures  arc: 

1.  Group  the  random  variables  into  pairs    [  (X,,Xm+ .),  .  .  .  ,  (Xm  ,Xn)  ]  where 
m  =  n/2. 

2.  Replace  each  pair  with  a  (  +  )  if  (X+-  >  X-)  or  a  (  -)  if  (Xm+i  <  Xj). 

3.  Let  n  equal  the  number  of  ( +  )'s  and  (  —  )'s.  Let  T      equal  the  number  of  ( +  )'s 
and  T      equal  the  number  of  (  —  )'s. 

4.  Set  up  a  binomial  test  with  parameters  (n,  .5). 

5.  Accept  or  reject  the  null  hypothesis  using  the  test  statistic  T     . 

Notice  the  arrangement  of  random  variables.  If  an  upward  trend  exists,  the  smallest 
numbers  will  be  near  the  beginning  of  the  sequence  and  the  larger  numbers  near  the 
end.  The  design  helps  to  display  this  increasing  trend.  If  an  upward  trend  is  present. 
the  number  of  (  +  )'s  will  be  greater  than  the  number  of  (  —  )'s.  If  a  truly  random 
pattern  existed,  the  number  of  (  +  )'s  should  be  approximately  equal  to  the  number  of 
(-)'s,(T+   *  T"). 

To  test  whether  the  number  of  ( +  )'s  is  significantly  different  than  the  number 
of  ( —  )'s,  we  use  the  binomial  test  with  parameters  (n,p)  where  n  =  T  +  T  and 
p  =  .5. 

We  tested  all  data  sets  using  the  above  procedures.  Figures  3.10  through  3.21 
provide  the  specific  results.   They  are  laid  out  in  the  following  manner. 

AT  Figure  3.10  Percent  Losses  from  Boot  Camp 

Figure  3.11  Cox  and  Stuart  Test  Results 

Figure  3.12  Percent  Losses  from  A-School 

Figure  3.13  Cox  and  Stuart  Test  Results 

AW         Figure  3.14  Percent  Losses  from  Boot  Camp 

Figure  3.15  Cox  and  Stuart  Test  Results 

Figure  3.16  Percent  Losses  from  A-School 

Figure  3.17  Cox  and  Stuart  Test  Results 

AX  Figure  3.18  Percent  Losses  from  Boot  Camp 

Figure  3.19  Cox  and  Stuart  Test  Results 

Figure  3.20  Percent  Losses  from  A-School 

Figure  3.21  Cox  and  Stuart  Test  Results 
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Figures  3.10,  3.14,  and  3. IS  graphically  display  the  percent  losses  from  Boot  Camp. 
Similarly,  Figures  3.12,  3.16,  and  3.20  graphically  display  the  percent  losses  from 
A-school.  Figures  3.11,  3.15,  and  3.19  provide  the  Cox  and  Stuart  test  results  for  data 
sets  pertaining  to  Boot  Camp.  Similarly  Figures  3.13,  3.17,  and  3.21  provide  the  Cox 
and  Stuart  test  results  for  attrition  losses  in  A-school.  In  all  cases,  we  accepted  the 
null  hypothesis;  Attrition  is  not  increasing. 

2.  Attrition  rates:    Is  it  rising? 

What  is  the  attrition  rate  during  basic  training! 
Is  the  attrition  rate  higher  this  year  than  last  year? 

These  two  questions  form  the  basis  of  this  subsection.  Two  models  are 
presented.  The  first  model  is  used  to  estimate  the  attrition  rates.  The  second  model 
determines  if  the  rates  arc  increasing. 

a.    Estimation  of  attrition  rates 
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Figure  3.1 1     AT:   Cox  and  Stuart  Test  Results  #1. 
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Figure  3.13    AT:   Cox  and  Stuart  Test  Results  #2. 
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Picure  3.15     AW:    Cox  and  Stuart  Test  Results  #1. 
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Figure  3.16    AW:    Percent  losses  from  A-school. 
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Figure  3.17     AW;    Cox  and  Stuart  Test  Results  #2. 
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Figure  3.18     AX:    Percent  losses  from  Boot  Camp. 
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Figure  3.19     AX:    Cox  and  Stuart  Test  Results  #1. 
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Figure  3.21     AX:   Cox  and  Stuart  Test  Results  #2. 
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This  is  a  simple  nonlinear  model  with  one  parameter  (k--)  to  be  estimated 
per  cell.  Imbedded  within  the  model  is  a  couple  of  things  worth  mentioning.  The 
e  ij  term  represents  the  probability  an  individual  from  group  (i.j)  remains  in  the  Navy 
till  time  t.  This  is  the  exponential  survival  function.  Let  T-:  be  the  random  variable 
that  represents  the  probability  distribution  with  survival  function  e ij  .  Due  to  the 
uniqueness  of  survival  functions,  T-  ~  EXP(X-:).  Hence,  the  time  spent  in  basic 
training  is  exponentially  distributed.  The  next  term  to  look,  at  is  n--e"  ijr.  Mere  n-: 
represents  the  number  of  individuals  from  rating  i  and  year  group  j  and  c  ij1  is  the 
probability  an  individual  from  group  (i,j)  survives  till  time  t.  So,  n-e  ij  is  nothing 
more  than  the  expected  value  of  a  Binomial  random  variable  with  parameters 
(n,  p)  =  (n-:,  e  ij1).  Now  let's  look  at  the  model  in  it's  entirety, 
[  N-  =  n-e  ij  +  c-  ].  For  a  given  t,  N-  can  be  thought  of  as  a  systematic  term  plus 
some  noise  (£-).  The  systematic  term  is  the  expected  value  of  a  binomial  distribution. 
It  represents  the  expected  number  of  survivors  at  time  t. 

Our  goal  is  to  estimate  X--.  We  used  the  NLIN  procedure  in  SAS  to 
estimate  the  parameter  X  for  each  group.  See  Appendix  C  for  a  copy  of  the  SAS 
program  and  the  data  vectors  used  by  the  program.   Table  X  provides  the  results. 

b.   Are  attrition  rates  increasing! 
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81 

82 

83 

AW 

Yi 

MODEL:   Yj  =  p0  +  p1Xi  +  z[ 

INDEX:   i  =  year  group 

Y:     =  attrition  rate  for  year  group  i 

{L     =  constant  attrition  rate  for  all  year  groups 

p,      =  change  in  Y  due  to  a  one  unit  change  in  X  (slope) 

X:     =  year  group  i 

C:      =  error  terms  that  arc  iid  N(0,(72) 
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TABLE  X 

ATTRITION  RATES 

X  = 

ATTRITION  RATE 

77 

AT 

AW 

AX 

.0102 
(.0017) 

78 

.0094 
(.0008)' 

79 

.0128 
(.0012) 

80 

.0087 
(.0006) 

81 

.0041 
(.0002) 

.0145 
(.0015) 

.0175 
(.0017) 

82 

.0060 
(.0003) 

.0127 
(.0013) 

.0047 
(.0003) 

83 

.0048 
(.0004) 

.0168 
(.0013) 

.023 1 
(.0012) 

84 

.0067 
(.0007) 

.0123 
(.0024) 

.0326 
(.0054) 

.xxxx 

«-  estimate  of  X- 

(•yyyy) 

«-  asymptotic  standard  error  of  the  estimate 

Recall  event  B  defined  in  our  problem  statement:  Attrtion  is  increasing. 
We  will  use  the  linear  regression  model  [  Y-  =  p0  +  (LjXj  +  c-  ]  to  ascertain  the 
validity  of  the  statement.  The  linear  regression  model  permits  us  to  statistically  verify 
event  B.  We  will  test  the  regression  coefficient  pj.  If  pj  is  statistically  greater  than 
zero,  then  we  will  conclude:  'Attrition  rates  are  increasing."  Let  us  set  up  our 
hypothesis  test. 

Test  number  one  is  the  F-tcst.  As  stated  in  Draper  and  Smith,  [Ref.  4:  p. 
32J,  the  F-tcst  will  determine  if  a  trend  exists  in  the  regression  equation.  The 
hypothesis  test  and  decision  rule  associated  with  this  test  are  listed  in  Table  XL 
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TABLE  XI 
LINEAR  REGRESSION  F-TEST  #1 

l\Q:   P1  =  0   [Attrition  rates  are  constant.] 
H,:    p1  *  0   [Attrition  rates  are  not  constant.] 

If  F*  <  F(.95,  1,  n-2)  then  conclude  HQ 
If  F*  >  F(.95,  I,  n-2)  then  conclude  H{ 


Test  number  two  is  the  one  sided  t-test.  This  test  is  used  after  the  F-test.  If  the  F-test 
determines  that  a  trend  exists,  then  this  test  will  determine  the  direction  of  the  trend 
[Ref.  2:  p.  68].  The  hypothesis  test  and  the  decision  rule  associated  with  the  one  sided 
t-test  are  listed  in  Table  XII. 


TABLE  XII 

LINEAR  REGRESSION  t- 

■TEST#1 

H„: 

Pi 

<  0 

[Attrition  rates  are  not  increasing.] 

H,: 

P. 

>  0 

[Attrition  rates  are  increasing.] 

ir  t-: 

< 

t(.95 

n-2)  then  conclude  H0 

iff 

> 

t(.95, 

n-2)  then  conclude  H, 

We  performed  three  tests.  See  Figures  3.22,  3.23,  and  3.24  for  specific 
results.  The  F-test  results  are  listed  in  Table  XI II.  In  all  three  cases,  F*  ^  F.  By  our 
decision  rule,  we  accept  I-L  and  conclude:  "Attrition  rates  are  constant."  The  one  sided 
t-test    sequentially    follows    the    F-tcst.     Our    results    show    that    the    F-test    is    not 
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statistically  significant.  In  view  of  this  fact,  it's  not  necessary  to  perform  the  t-test. 
However,  details  of  the  t-test  are  listed  in  figures  3.22,  3.23,  and  3.24.  We  summarize 
the  results  of  the  one  sided  t-test  by  saying,  "Attrition  rates  are  not  increasing." 


TABLE  XIII 
REGRESSION  ON  ATTRITION  RATES:  F-TEST  RESULTS 

Rating                F*             n              F(.95,l,n-2) 

AT 

AW 

AX 

2.14             4                    18.50 
3.72              8                      5.99 
1.99             4                    18.50 

C.       SPECIALIZED  TRAINING 

The  third  event  of  our  problem  statement  is:  The  amount  of  specialized  training 
has  increased.  As  previously  discussed,  we  will  measure  the  amount  of  specialized 
training  by  counting  the  number  of  NEC's  an  individual  acquires.  Secondly,  the 
measurement  will  take  place  during  the  individual's  second  and  third  year  of  service. 
Two  methods  are  presented.  Given  a  year  group,  we  looked  at  the  average  number  of 
NEC's  per  individual.  We  plugged  these  numbers  into  a  regression  model  and  tested 
this  sequence  to  determine  if  an  increasing  trend  existed.  Method  number  two  used  a 
random  sample  of  individuals  from  each  year  group.  A  balanced  design  ANOVA 
model  determined  if  the  average  number  of  NEC's  per  year  group  differed.  The 
ensuing  analysis  excludes  year  group  84  because  the  data  base  does  not  cover  their 
third  year  of  service. 
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Figure  3.22     AT:    Attrition  rates  -  Regression  results. 
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Figure  3.23     AW:   Attrition  rates  -  Regression  results. 
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AX:   losses  per  month 
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Ficure  3.24     AX:   Attrition  rates  -  Resression  results. 


60 


1.  Average  number  of  NEC's  per  individual:   Has  it  increased? 


TABLE  XIV 

AVERAGE  NUMBER  OF  NEC'S  PER  INDIVIDUAL 

AT 

i 
81 

NECj 

Ni 

AVG 

369 

232 

1.5905 

82 

1010 

524 

1.9275 

83 

619 

365 

1.6959 

AW 

77 

114 

70 

1.6286 

78 

154 

102 

1.5098 

79 

349 

165 

2.1152 

80 

422 

213 

1.9812 

81 

352 

177 

1.9887 

82 

668 

304 

2.1974 

83 

444 

243 

1.8272 

AX 

81 

58 

33 

1.7576 

82 

255 

139 

1.8345 

83 

133 

79 

1.6835 

For  each  rating  and  year  group,  Table  XIV  lists  the  average  number  of  NEC's 
per  individual.   This  number  is  (NECj  /  N-)  where: 

NEC:    =  number  of  NEC's  acquired  by  year  group  i 

N:  =  number  of  individuals  in  year  group  i 

We  will  set  up  the  regression  model  and  statistically  test  these  table  values  for  an 
upward  trend.   The  model  is  hereby  defined. 
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MODEL:   Yj  =  pQ  +  0^  +  £; 

INDEX:   i  =  year  group 

Y:     =  average  number  of  NEC's  per  individual  from  year  group  i 

P0     =  constant  number  of  NEC's  per  individual 

p\     =  change  in  Y  per  unit  change  in  X  (slope) 

Xj     =  year  group  i 

£•      =  error  terms  that  are  iid  N(0,  g  ) 

The  same  methodology  presented  in  the  previous  section  will  be  used.  The 
F-test  will  determine  if  a  trend  exists  and  the  one  sided  t-test  will  ascertain  the  direction 
of  the  trend.  The  hypothesis  tests  and  decision  rules  are  presented  in  Tables  XV  and 
XVI. 

See  Figures  3.25,  3.26,  and  3.27.  The  test  results  clearly  show  that  a  trend  is 
absent.  The  F-test  forces  us  to  accept  the  null  hypothesis  in  all  three  cases.  Likewise, 
the  t-test  directs  us  to  accept  the  null  hypothesis.  We  conclude  this  subsection  by 
saying:    "The  average  number  of  NEC's  per  individual  is  not  increasing." 

2.  Average  number  of  NEC's  per  year  group:   Has  it  increased? 

The  first  method  for  determining  the  amount  of  specialized  training  condensed 
our  data  base  into  a  few  observations.  We  all  know  that  a  small  sample  size  does  not 
provide  a  powerful  statistical  result.  The  second  method  uses  the  single  factor 
ANOVA  model.  We  wanted  to  increase  the  number  of  observations  in  the  test  and  use 
a  balanced  design.  We  took  a  random  sample  of  30  data  points  from  each  year  group 
and  tested  the  sample  means  for  statistical  differences.    We  present  the  model. 
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TABLE  XV 

LINEAR  REGRESSION  F-TEST 

#2 

H0: 

IV 

=  0 

Hr 

Pi  *o 

H0: 

The 

average 

number  of  NEC's  per  individual  is 

constant. 

Hr 

The 

average 

number  of  NEC's  per  individual  is 

not  constant. 

IfF 

*  < 

F(.95,  1 

n-2)  then  conclude  LL 

If  F 

*  > 

F(.95,  1, 

n-2)  then  conclude  H1 

TABLE  XVI 
LINEAR  REGRESSION  t-TEST  #2 

H0:    P,   <  0 
FL:   P,  >  0 

LL:    The  average  number  of  NEC's  per  individual  is  not  rising. 
FL:    The  average  number  of  NEC's  per  individual  is  rising. 

If  t*  <  t(.95,  n-2)  then  conclude  II0 
If  t*  >  t(.95,  n-2)  then  conclude  ITj 
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Figure  3.25     AT:    NEC's  per  individual  -  Regression  results. 
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Figure  3.26    AW:   NEC's  per  individual  -  Regression  results. 
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AX:   NEC's  per  person 
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Figure  3.27    AX:   NEC's  per  individual  -  Regression  results. 
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MODEL:    Y: 


ij 


INDICES: 


H  +   Z[  +   €■■ 


i  =  year  group 


T; 


j  =  j      individual  from  cell  i  (j  =   1,  .  .  .  ,  30) 
=  number  of  NEC's  acquired  by  the  j      individual  from  cell  i 
=  average  number  of  NEC's  per  individual 

=  additional  number  of  NEC's  an  individual  from  year  group  i  receives 
=  error  terms  that  are  iid  N(0,<T") 


We  will  follow  the  same  outline  presented  earlier  when  we  used  the  single 
factor  ANOVA  model  to  analyze  the  length  of  basic  training.  Our  objectives  for  this 
section  are: 

•  Estimate  the  mean  number  of  NEC's  per  year  group. 

•  Statistically  test  the  means  for  differences. 

•  Rank  the  means  using  a  paired  comparison  test. 

The  ANOVA  model  and  the  Kruskal-Wallis  (KW)  test  will  determine  if  the  means 
differ.  Tukey's  paired  comparison  test  will  rank  the  means.  The  hypothesis  tests 
associated  with  the  Analysis  of  Variance  model  and  the  Kruskal-Wallis  test  arc  listed  in 
Table  XVII.   The  decision  rules  are  also  listed  in  Table  XVII. 

Test  results,  tables,  and  figures  that  support  this  subsection  are  grouped 
together.   They  are  laid  out  in  the  following  manner. 
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TABLE  XVII 

SINGLE  FACTOR  ANOVA  HYPOTHESIS  TEST  #2 

H0: 

hi 

= 

T83 

Hr 

T77 

*    .  . 

•     ^TS3 

H0: 

The 

mean 

number  of  NEC's  per  year  group 

has 

remained  constant. 

«r 

Not 

all  the  means  are  equal. 

-ANOVA- 

If  P 

< 

F(.95, 

Vj,  v0)  then 

conclude  HQ 

If  P 

'■  > 

F(.95, 

Vp  v2)  then 

conclude  H, 

-KW 

r 

ur 

'KW 

<  r(.95,  V)  then 

conclude  HQ 

\rr 

> 
'KW 

>  r 

'(.95,  v)  then 

conclude  H, 

AT 


Figure  3.28       Data  Analysis  Graphs 

Table  XVIII    ANOVA/ KW  test  results 

Figure  3.29       Tukey's  paired  comparison  test  results 


AW 


AX 


Figure  3.30 
Table  XIX 
Figure  3.31 

Figure  3.32 
Table  XX 
Figure  3.33 


Data  Analysis  Graphs 

ANOVA,  KW  test  results 

Tukey's  paired  comparison  test  results 

Data  Analysis  Graphs 

ANOVA/ KW  test  results 

Tukey's  paired  comparison  test  results 


Figures  3.28,  3.30,  and  3.32  provide  a  graphical  summary  of  the  data  sets.  Tables 
XVIII,  XIX,  and  XX  provide  the  ANOVA  test  results  and  the  Kruskal-Wallis  test 
results.    Figures  3.29,  3.31,  and  3.33  provide  Tukey's  paired  comparison  test  results. 
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These  figures  display  a  graphical  ranking  of  the  means.    Specific  results  arc  listed  in  the 
figures  and  tables.    We  summarize  the  findings. 

•  AT  rating:  (F*  <  F)  and  (X  KW  <  a  )•  ^  our  decision  rule,  we  accept  H0 
and  conclude,  "The  mean  number  of  NEC's  acquired  per  year  group  has  remained 
constant." 

•  AW  rating:  The  P  value  is  .001.  The  test  results  are  statistically  significant.  The 
elements  of  the  z  vector  are  not  equal.  Using  our  decision  rule,  we  accept  the 
alternate  hypothesis.  Figure  3.31  provides  a  closer  look  at  the  differences.  All 
means  are  grouped  together  under  category  A  except  year  group  78.  Those 
grouped  together  are  not  statistically  different.  Year  Group  78  does  not  belong 
to  group  A,  but  look  at  the  numbers.  In  particular,  look  at  the  largest  mean 
(2.1),  and  look  at  the  smallest  mean  (1.3).  The  difference  is  statistically 
significant  but  not  operationally  significant!*"  We  conclude  by  saying:  "A  change 
occur ed  but  it  is  not  operationally  significant  to  influence  training  costs." 

•  AX  rating:  (F*  <  F)  and  (X  KW  <  X  )■  By  our  decision  rule,  we  accept  H0 
and  draw  the  same  conclusion  stated  for  the  AT  rating,  no  increase. 


"We  defined  operationally  significant  as  a  factor  of  two  or  more.  For.  first  term 
enlistees,  increasing  the  number  of  NFC's  up  to  a  factor  two  should  have  little  effect 
on  training  costs.  HThe  Navy's  C-schools  should  have  the  capacity  to  train,  more  first 
terms  enlistees.  Flowever,  (2  x  1.3)  =  2.6  which  is  fairly  close"  to  2.1.  I  here  is  a 
possibility  that  this  change  has  more  importance  than  we've  given  it. 
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Figure  3.28    AT:   NEC's  per  year  group. 
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TABLE  XVIII 

AT:    NEC'S  PER  YEAR  GROUP 
ANOVA  TEST  RESULTS 

-PERCENTILES- 

i        nj 

% 

]X   +    Ti 

ffi 

0.25         0.50 

0.75 

81       30 

33.3 

1.700 

0.6513 

1              2 

2 

82       30 

33.3 

1.933 

0.7397 

1              2 

2 

83       30 

33.3 

1.567 

0.6261 

1               1 

2 

90 

100.0 

1.733 

0.6837 

1              2 

2 

CLASS          LEVELS 

VALUES 

T 

3 

81  82  83 

s 

df 

2 

SS 

MS 

F*      PR>F* 

Model 

2.0667 

1.0333 

2.27      0.1089 

Error 

87 

39.5333 

0.4544 

Total 

89 

41.6000 

R2 

c.v. 

Vmse 

HY 

0.0497 

38.8902 

0.674C 

1.7333 

KRUSKAL-WALLIS  NONPARAMETRIC  TEST  FOR  EQUAL  MEANS 

df 

2 

2 
X  KW 

PR  >  x2(.95,  2) 

4.1309 

0.1268 

F(- 

95,2,87)  =  3.11      x2(-95, 

2)  =  5.99 
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Figure  3.29    AT:   Tukey's  paired  comparison  test  results  #2. 
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Figure  3.30    AW:   NEC's  per  year  group. 
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TABLE  XIX 

AW:   NEC'S  PER  YEAR  GROUP 
ANOVA  TEST  RESULTS 

-PERCENTILES- 

i 

77 

30 

% 

14.3 

\l   +    Tj 

(71            0.25 

0.50         0.75 
2              2 

1.567 

0.5940            1 

78 

30 

14.3 

1.300 

0.6513            1 

1              2 

79 

30 

14.3 

1.800 

0.9966            1 

2              2 

80 

30 

14.3 

1.867 

0.8604            1 

2             2 

81 

30 

14.3 

1.S67 

0.6815            1 

2             2 

82 

30 

14.3 

2.100 

0.6074            2 

2             2 

83 

30 

14.3 

1.633 

0.7184            1 

1              2 

210 

100.0 

1.733 

0.7611            1 

2             2 

CLASS          LEVELS 

VALUES 

t 

7 

77  78  79  SO  81 

82  83 

S 

df 
6 

SS 

MS            F* 

PR>F* 

Model 

12.0000 

2.0000          3.73 

0.0016 

Error 

203 

109.0667 

0.5372 

Total 

209 

121.0667 

R2 

c.v. 

VMSE 

HY 

0.0991 

42.2S79 

0.7330 

1.7333 

KRUSKAL-WALLIS  NONPARAMETRIC  TEST  FOR  EQUAL  MEANS 

df 
6 

Y2 
/  KW 

PR  >  x2(-95,  6) 

21.65 

0.0014 

F(.95,6,203)  =  2 

10      r(.95,6)  =   12. 
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Figure  3.31     AW:   Tukcy's  paired  comparison  test  results  #2. 
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Figure  3.32    AX:   NEC's  per  year  group. 
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TABLE  XX 

AX:   NEC'S  PER  YEAR  GROUP 
ANOVA  TEST  RESULTS 

-PERCENTILES- 

i        nj 

% 

H  -I-  tj 

Cj           0.25         0.50 

0.75 

81       30 

33.3 
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0.7279            1              2 

2 

82       30 
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2 
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0.6215            1               1 

2 

90 

100.0 
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T 

3 

81  82  83 

s 

df 

2 

SS 

MS            F*      PR>  F* 

Model 

2.0667 

1.0333          2.53      0.0855 

Error 

87 
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0.40S4 

Total 
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Figure  3.33     AX:   Tukey's  paired  comparison  test  results  #2. 
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IV.  MAIN  RESULTS  AND  CONCLUSIONS 

We  started  off  with  the  following  question,  "What  are  the  factors  causing  training 
costs  to  rise?"  To  understand  the  problem,  we  formulated  several  reasons  why  we 
think  training  costs  are  rising.   Those  reasons  are: 

•  The  length  of  basic  training  has  increased. 

•  Attrition  has  increased. 

•  The  amount  of  specialized  training  has  increased. 

We  set  out  to  verify  those  reasons  using  some  historical  data  compiled  by  CNA. 

The  scope  of  this  study  is  limited.  The  results  are  valid  within  the  following 
confines. 

•  Inferences  are  made  with  respect  to  these  enlisted  ratings,  AT,  AW,  and  AX. 

•  The  expected  career  path  is  Boot  Camp  -»  A-School  -»  Fleet.     Inferences  are 
further  restricted  to  those  individuals  that  followed  the  expected  career  path. 

•  The  overall  time  frame  is  restricted  to  the  first  enlistment  period. 

•  The  first  24  months  is  the  time  constraint  for  two  areas  of  study,  Basic  Training 
and  Attrition. 

•  The  second  and  third  years  of  service  is  the  time  constraint  for  the  last  area  of 
study,  Specialized  Training. 

A.       SUMMARY 

1.  (Length  of  Basic  Training  —  not  a  factor)  The  length  of  basic  training  has 
cycled  up  and  down.  It  has  fluctuated  over  the  years  but  there  is  no  evidence 
to  suggest  a  steady  increase  over  the  years.  Figures  4.1,  4.2,  and  4.3  provide 
graphical  summaries.  In  all  three  cases,  the  final  trend  is  encouraging,  the 
length  of  basic  training  has  decreased. 

2.  (Attrition  —  not  a  factor)  Losses  in  Basic  Training  are  roughly  constant  from 
year  to  year.   Attrition  has  not  increased. 

3.  (Amount  of  specialized  training  —  not  a  factor)  Specialized  training  has 
remained  constant.   The  amount  has  not  increased. 
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Figure  4.1     AT:    Length  of  basic  training. 
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Figure  4.2    AW:    Length  of  basic  training. 
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Figure  4.3     AX:    Length  of  basic  training. 
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B.       RECOMMENDATIONS 

This  study  looked  at  a  small  piece  of  the  problem.  The  final  result  is  that  we 
were  unable  to  identify  any  factors  causing  training  costs  to  rise.  However,  here  is  a 
list  of  general  questions  that  may  be  of  interest  for  further  research. 

1.  Has  the  length  of  basic  training  increased  for  enlisted  ratings  other  than  AT, 
AW,  and  AX? 

2.  Has   the   amount   of  specialized  training   increased   after   the   first   enlistment 
period? 

3.  Is  the  selection  process  effective?3 

4.  Has  the  Training  Command's  support  costs  increased? 

5.  Are  training  costs  rising  due  to  increased  or  improved  training  resources? 

This  list  is  by  no  means  exhaustive.    It  is  a  few  questions  that  we  can  ask.  but  were 
unable  to  answer  in  this  study. 


The  selection  process  is  primarily  based  upon  test  scores  and  education  level.  If 
the  selection  process  is  effective,  then  people  screened  for  a  particular  rating  will 
complete  that  training  prosram.  The  attrition  rate  will  be  low  and  survivability  high. 
However,  if  we  do  not  screen  people  properlv,  the  number  of  people  that  complete  the 
program  will  be  much  less  than  optimal.  Attrition  will  be  high.  The  cilcct  is  higher 
training  costs.   An  elfectivc  selection  process  produces  savings. 
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APPENDIX  A 
MODEL  ASSUMPTIONS 

Throughout  this  study,  we  used  two  models  extensively,  the  REGRESSION 
model  and  the  ANOVA  model.  Both  models  helped  us  to  conceptualize  the  problem 
and  analyze  the  observations.  The  purpose  of  both  models  is  to  describe  the  events  of 
the  past.  These  models  are  also  used  to  predict  and  control  events,  but  we're  not 
interested  in  using  it  for  those  matters. 

In  this  appendix,  we  will  briefly  assess  the  aptness  of  the  model.  Is  the  model 
appropriate  for  the  data  set  at  hand?  This  is  an  important  question.  It  should  be 
answered  whenever  models  are  used.  The  importance  of  aptness  is  best  described  by 
logic's  implication  statement,  if  P  then  Q,  (P  -»  Q).  If  the  model  is  appropriate,  then 
the  ensuing  analysis  presented  by  the  model  is  correct.  Good  analysis  is  conditioned 
on  the  fact  that  the  analyst  use  the  appropriate  models.  The  appropriateness  of  a 
model  is  dependent  upon  adherence  to  the  assumptions  imbedded  within  the  model. 

We  emphasized  the  importance  of  examining  the  aptness  of  a  model,  but  how  do 
we  confirm  that  a  model  is  appropriate?  Residual  analysis  is  the  tool  for  this  task.  It 
is  highly  effective  for  spotting  major  departures  from  the  assumed  model.  Our  goal  is 
to  verify  the  model  assumptions  by  using  residual  analysis.  In  the  statistical  world,  this 
verification  follows  the  mentality  used  in  the  U.S.  court  system,  where  we  assume  the 
defendant  to  be  innocent  and  prove  beyond  reason  of  doubt  that  the  person  is  guilty. 
In  our  profession,  we  assume  the  model  assumptions  arc  correct  and  prove  otherwise. 
The  major  purpose  of  residual  analysis  is  to  detect  serious  departures  from  the 
conditions  assumed  by  the  model. 

Strict  adherence  to  every  assumption  is  not  possible  with  this  data  set.  A  few 
departures  exist  however,  the  departures  are  not  substantial.  Our  first  discussion 
centers  around  the  regression  model.  The  second  part  deals  with  the  ANOVA  model. 
Assumptions  arc  listed  for  each  model.  This  is  followed  by  a  short  summary  discussing 
the  verification  procedures  and  any  effects  caused  by  a  departure  from  the  model. 
Figures  and  tables  pertain  to  the  AW  rating.  Similar  results  were  obtained  for  the  AT 
and  AX  ratings. 
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1.        REGRESSION 

We  used  graphical  means  to  confirm  the  assumptions  imbedded  within  the 
regression  model.  (See  Table  XXI.)  The  assumptions  are  listed  in  column  one.  The 
plots  used  to  confirm  these  assumptions  are  listed  in  column  two.  Our  goal  is  to 
ensure  the  assumptions  are  plausible  in  light  of  the  data. 


Assumption 


TABLE  XXI 
REGRESSION  MODEL  ASSUMPTIONS 

Verification 


1.  The  relationship  is  linear. 

2.  The  error  terms  are  independent. 

3.  The  error  terms  have  constant  variance. 

4.  The  error  terms  are  normally  distributed. 


Scatter  Plot 

RES  ID  vs  X 
RESID  vs  YMAT 

RES  ID  vs  X 
RESID  vs  YHAT 


Q-Q  Plot 


a.  The  relationship  is  linear. 

Whether  or  not  a  linear  regression  function  is  appropriate  for  the  data  set  at 
hand  being  analyzed,  can  often  be  studied  by  a  scatter  plot  of  the  data.  (See  Figure 
A.l.)  These  scatter  plots  are  an  effective  means  to  examine  the  appropriateness  of  the 
linear  regression  function.  Notice  that  these  plots  do  not  exhibit  any  departures  from 
the  model. 

b.  The  errors  are  independent  and  have  constant  variance. 

If  the  model  correctly  describes  the  observations,  the  (RESID  vs  X)  plot  and 
the  (RESID  vs  YHAT)  plot  should  display  a  pattern  that's  uniformly  distributed  within 
a  horizontal  band  centered  at  zero.  (See  Figures  A. 2  and  A. 3.)  It  portrays  the 
prescribed  behavior.    No  trends  are  present. 
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c.  The  error  terms  are  normal. 

The  residuals  should  resemble  observations  taken  from  a  normal  distribution. 
The  Q-Q  plots  are  used  to  confirm  this.  Figure  A. 4  displays  these  plots.  They  appear 
to  be  normally  distributed. 

In  summary,  no  serious  departures  from  the  assumptions  were  noted.  The 
linear  regression  model  is  appropriate  for  the  data  set  at  hand. 

2.        ANALYSIS  OF  VARIANCE 

The  assumptions  imbedded  within  the  ANOVA  model  are  similar  to  the 
regression  model.  See  Table  XXII  for  a  list  of  the  assumptions  and  the  verification 
method. 


TABLE  XXII 

ANOVA  MODEL  ASSUMPTIONS 

A. 

ssumption 

Verification 

1. 

The  populations  are  normally  distributed. 

2. 

The  population  variances  arc  equal. 

Bartlett  Test 
Hartley  Test 

3. 

The  error  terms  are  independent. 

Durbin-Watson  Test 

4. 

The  error  terms  have  constant  variance. 

RESID  vs  X 
RES  ID  vs  YHAT 

5. 

The  error  terms  are  normally  distributed. 

Histogram 

a.  The  populations  are  normally  distributed. 

The  first  assumption  requires  the  populations  to  be  normally  distributed. 
Formal  verification  will  not  be  presented  here.  It  will  suffice  to  say  that  upon 
examination  of  the  data  sets,  we  found  most  of  the  populations  to  lack  normality. 
Here  in  lies  the  first  departure  from  the  model,  but  the  departure  is  not  large.  Lack  of 
normality  is  not  an  important  matter  provided  the  departure  from  normality  is  not  of 
extreme  form.    The  point  estimators  of  factor  level  means  and  contrasts  arc  unbiased 
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whether  or  not  the  populations  are  normal.  The  F-test  for  equality  of  means  is  but 
little  affected  by  lack  of  normality,  either  in  terms  of  level  of  significance  or  power  of" 
the  test.  Hence  the  F-test  is  a  robust  test  against  departures  from  normality.  [Ref.  2: 
p.  624] 

b.  The  population  variances  are  equal. 

The  second  assumption  requires  equal  variances.  We  used  the  Bartlett  test  or 
the  Hartley  test  to  verify  homogeniety  of  variance.  Let's  discuss  where  we  applied  each 
test. 

/.    Basic  Training:   Bartlett  Test  -  {unequal  sample  sizes) 

The  idea  underlying  Bartlett's  test4  is  simple.    By  definition: 

MSE  =  (l/dfT)£df  Sj2  (cqn  A.l) 


GMSE  =  [(Sj2)^    x   ...   x  (sn2)dfn  ]  O/dfj)  (eqnA.2) 

The  relationship  between  the  arithmetic  mean  and  the  geometric  mean  is: 

GMSE  <  MSE  (eqn  A. 3) 

The  two  averages  will  be  equal  if  s;  =  s-  hence  if  the  ratio  (MSE/GMSE)  is  close  to 
one,  we  have  evidence  the  variances  are  equal.  If  the  ratio  is  large,  it  indicates  that  the 
population  variances  are  unequal.    Bartlett's  test  statistic  is  computed  as  follows: 

X2B  -  (  dfT/C  )(  logeMSE  -  logeGMSE  )  (cqn  A.4) 

where: 

C  =  1  +  [l/3(n  -   1)]  {  [  V(i/df.)  ]  -  (l/dfT)  }  (cqn  A.5) 


[Ref.  2:  Sec.  18.6]  provides  a  detailed  discussion  of  this  test. 
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The  population  variances  are  listed  in  Table  XXIII.  We  statistically  tested 
these  values  to  dcgcrminc  if  they  were  equal.  The  hypothesis  test  and  decision  rule 
associated  with  Bartlett's  test  arc  listed  in  Table  XXIII.  The  results  are  also  listed  in 
Table  XXIII. 

With  respect  to  the  AW  and  AX  ratings,  we  accept  the  null  hypothesis  and 
conclude,  the  population  variances  are  equal.  However,  we  cannot  say  the  same  for 
the  AT  rating.  Departure  from  this  model  assumption  has  some  effect.  How  sensitive 
is  the  model  with  respect  to  this  departure? 

When  the  error  variances  are  unequal,  the  F-test  for  equality  of  means  is 
only  slightly  affected  if  all  factor  level  sample  sizes  are  equal  or  do  not  differ  greatly. 
Specifically,  unequal  error  variances  raise  the  actual  level  of  significance  only  slightly 
higher  than  the  specified  level.  The  F-test  is  robust  against  unequal  variances  when  the 
sample  sizes  are  approximately  equal.   [Ref.  2:  p.  624]. 

Let's  look  at  this  aspect  more  closely.  For  the  AT  rating,  the  population 
variances  are  unequal  and  the  sample  sizes  are  unequal.  We  expect  the  significance 
level  to  be  inflated.  However,  if  a  large  inflation  factor  existed,  it  would  not  have 
affected  this  ANOVA  test  very  much.  This  is  due  to  the  fact  that  the  test  results  were 
significant  at  the  .0001  level!  The  difference  in  means  is  causing  the  significance  level 
to  be  extremely  small.  It's  overpowering  any  inflationary  effect  caused  by  unequal 
variances.  The  actual  probability  that  the  means  are  equal  is  somewhat  less  than 
.0001.  In  summary,  a  departure  from  the  model  is  present,  the  population  variances 
are  not  equal.  However,  this  does  not  bias  the  true  results  very  much.  In  this  case,  we 
accept  the  validity  of  the  F-test  results. 

2.   Specialized  Training:    Hartley  Test  -  (equal  sample  sizes) 

For  equal  sample  sizes,  Hartley's  test  for  equality  of  variance  is  based 
solely  on  the  largest  sample  variance  and  the  smallest  sample  variance.  Hartley's  test 
statistic  is  defined  as  follows: 

II*  =  max(s.2)/min(s.2)  (eqn  A. 6) 


[Ref.  2:  Sec.  18.6]  provides  a  detailed  discussion  of  this  test. 
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Clearly,  values  of  H*  near  one  support  the  claim  that  the  population  variances  are 
equal.  The  variances  for  each  population  are  listed  in  Table  XXIV.  The  hypothesis 
test  and  decision  rule  associated  with  the  Hartley  test  are  listed  in  Table  XXIV.  The 
results  are  also  listed  in  Table  XXIV.  For  all  three  test  cases,  we  conclude  the 
population  variances  are  equal. 

c.  The  error  terms  are  independent. 

The  third  assumption  requires  the  error  terms  to  be  independent.  Lack  of 
independence  can  have  serious  effects  on  the  inferences  made  using  the  AXOVA 
output.  The  observations  were  obtained  in  time  sequence,  so  there  is  a  good  chance 
the  error  terms  are  serially  correlated  or  autocorrelated. 

The  most  popular  test  for  first-order  autoregressive  errors  is  the 
Durbin-Watson  (D-W)  test.  It's  a  powerful  test  yet  extremely  easy  to  use.  See  [Ref.  5: 
Sec.  15.3]  for  a  detailed  commentary  on  the  (D-W)  statistic.  The  original  model 
specifies  the  error  terms  (£.)  to  be  independent  and  identically  distributed  N(0,ff  ) 
random  variables.  The  underlying  arguement  for  the  D-W  test  is  simple.  Model  the 
error  term  as  a  first-order  autoregressive  process  such  that: 

£j  =  p£M  4-  u.  (eqn  A. 7) 

where: 

p       =  autocorrelation  parameter  such  that  |p|  <   1 

l).      =  disturbance  terms  that  are  iid  N(0,<T2) 

Each  error  term  includes  a  fraction  of  the  previous  error  term  plus  a 
disturbance  term.  If  p  =  0,  then  E.  =  u.,  and  we're  back  to  our  original  assumption 
because  the  disturbance  terms  (o.)  are  independent.  The  D-W  test  determines  if  p  =  0. 
The  hypothesis  test  and  decision  rule  associated  with  the  D-W  test  are  listed  in  Table 
XXV.  The  Durbin-Watson  test  results  arc  also  listed  in  Table  XXV.  For  every  test 
case,  we  conclude:  "The  autocorrelation  parameter  p  is  zero  hence,  the  error  terms  are 
independent." 

d.  The  error  terms  have  constant  variance. 

Assumption  number  four  requires  the  error  terms  to  have  constant  variance. 
(See  Figures  A. 5  through  A. 8.)  We  plotcd  the  residuals  against  the  independent 
variable  and  the  fitted  value.    No  discernable  pattern  emerged.    The  residuals  lie  within 
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a  horizontal  band  centered  at  zero.  Notice  how  the  variance  stays  constant  through 
changes  on  the  X-axis.  This  behavior  is  the  expected  behavior  given  the  assumption  is 
correct.    These  plots  give  us  no  reason  to  reject  the  fourth  assumption. 

e.  The  error  terms  are  normally  distributed. 

The  last  assumption  requires  the  error  terms  to  be  normally  distributed.  We 
plotted  the  residuals  in  the  form  of  a  histogram.  (See  Figures  A. 9  and  A.  10.)  Both 
plots  resemble  a  normal  distribution  with  mean  zero.  These  plots  verify  the  last 
assumption. 

In  summary,  the  assumptions  are  reasonable.  We  have  no  reason  to  reject 
them  as  incorrect.  There  is  a  few  minor  departures  from  the  model,  but  due  to  the 
robustness  of  the  F-test,  these  departures  did  not  affect  the  final  results.  We  conclude: 
The  A  NOVA  model  is  appropriate  for  the  data  set  at  hand. 
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Figure  A.  1     AW  Regression:    Scatter  Plot. 
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Figure  A.4    AW  Regression:   Q-Q  Plot. 


94 


TABLE  XXIII 

TIME  TO  GET  RATED 
BARTLETT'S  TEST 


AT  81 

82 
83 

AW  77 
78 
79 
80 
81 
82 
83 

AX  81 

82 
83 


Hn:  a.2  =  .  .  .  =  a  : 

0  1  n 

H.:  a,2  *  .  .  .  *  <7  2 

1  1  n 


If  x2g  ^  X2(-95,  v)  then  conclude  HQ 
If  X  r  >  Z  (-95,  v)  then  conclude  Hj 


^i 

df. 
i 

l 

16.385 

225 

3.5600 

16.785 

520 

2.7153 

16.385 

364 

3.1104 

17.214 

69 

3.1249 

14.414 

98 

3.7743 

13.199 

160 

3.7895 

14.986 

208 

3.9559 

14.270 

173 

3.8829 

16.703 

302 

3.2781 

16.988 

242 

3.2721 

17.667 

32 

3.4157 

16.S63 

138 

2.9073 

1S.481 

78 

2.7496 

V 

2 

0 

X  b 

X2(.95,  v) 

•'• 

AT 

6.2084 

5.9915 

"i 

AW 

6 

4.7408 

12.5916 

«o 

AX 

2 

0.0598 

5.9915 

Ho 

95 


TABLE  XXIV 

NEC'S  PER  YEAR  GROUP 
HARTLEY'S  TEST 


AT 


AW 


AX 


H0:   ffj 
Hr   a, 


i 

* 

(If. 

i 

30 

a. 

i 

81 

1.700 

0.6513 

82 

1.933 

30 

0.7397 

83 

1.567 

30 

0.6261 

77 

1.567 

30 

0.5940 

78 

1.300 

30 

0.6513 

79 

1.800 

30 

0.9966 

80 

1.867 

30 

0.8604 

81 

1.867 

30 

0.6815 

82 

2.100 

30 

0.6074 

83 

1.633 

30 

0.71S4 

81 

1.767 

30 

0.7279 

82 

1.833 

30 

0.5560 

83 

1.400 

30 

0.6215 

2  _ 

2 
.  .  =  <7  " 

n 

2*. 

n 

If  H*  <  H(.95,  Vj,  v2)  then  conclude  HQ 
If  H*  >  H(.95,  Vj,  v2)  then  conclude  Hj 


vl 

3 

v2 
29 

II* 

H(.95,  vp  v2) 

AT 

1.3958 

2.4000 

I!0 

AW 

7 

29 

2.8149 

3.0200 

«o 

AX 

3 

29 

1.7139 

2.4000 

H0 

96 


TABLE  XXV 
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Figure  A. 5     AW  ANOVA:   Time  to  ect  rated  -  RES  ID  vs  X. 
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Figure  A. 6    AW  ANOVA:   NEC's  per  year  group  -  RESID  vs  X. 
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Figure  A. 9     AW  ANOVA:    Time  to  get  rated  -  Histogram  of  residuals. 
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Figure  A.  10    AW  ANOVA:    NEC's  per  year  group  -  Histogram  of  residuals. 
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APPENDIX  B 
DATA  BASE 

The  data  base  used  in  this  study  is  described  below.  Column  one  is  the  variable 
list.  Column  two  gives  the  location  of  the  variable  within  the  data  base.  Column  three 
is  a  description  of  the  variable. 

FIELD  POSITION         DESCRIPTION 


RECNUM  001-009  Record  number 

PGMCODE  010-013  Program  Code   (SG) 

RATING  014-016  Rating: 

AT  =  Aviation  Technician 

AW  =  Aviation  ASW  Operator 

AX  =  Aviation  ASW  Technician 

AREA  017-017  Recruiting  Area   (1,   3,   4,   5,   7,   8) 

SEX  018-018  1  =  Male 

0  =  Female 

CIVED  019-020     Civilian  education: 

This  is  the  number  of  years  of 
education  completed. 

GEDC  021-021     Graduate  education  code: 

1  =  High  school  diploma  graduate 

2  =  Probable  Graduate 

3  =  Graduate  equivalence  diploma 

4  =  Non-High  school  graduate 

WAVCE  022-022    Waiver  for  civilian  education: 

1  =  The  recruit  received  a  waiver  for 
entry  into  the  the  rating  program 
desired  due  to  lack  of  sufficient 
education 

0  =  otherwise. 

AFQT  023-025    Armed  Forces  Quotient  Test  score 

TESTSW  026-026     Test  score  waiver: 

1  =  The  recruit  received  a  waiver  for 
entry  into  the  the  rating  program 
desired  due  to  low  test  scores. 

0  =  otherwi  se. 

GS  027-029  General  Science  test  score 

AR  030-032  Arithmetic  Reasoning  test  score 

WK  033-035  Word  Knowledge  test  score 

PC  036-038  Paragraph  Comprehension  test  score 

ND  039-041  Numerical  Operations  test  score 

CS  042-044  Coding  Speed  test  score 
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AS 

MK 
MC 
EI 
RACE 


PAYGRD 
SCREEN 

MATCHS 

RTCFLG 
PDEPS 


RATE 

PAYGR 

ADSD 

PEBD 

EAOS 

COMPLD 

COURSE 

STUDAC 

AGE 
LEFTNAV 


045-047  Auto  Shop  test  score 

048-050  Math  Knowledge  test  score 

051-053  Mechanical  Comprehension  test  score 

054-056  Electronic  Information  test  score 

057-057     Race: 

C  =  Caucasian 

B  =  Black 

X  =  Other 

Z  =  Unknown 

R  =  American  Indian 

M  =  Asian 

058-058     Initial  Paygrade  (1-9) 

059-061     Screen  Score: 

This  is  the  probability  a  recruit 
will  complete  one  year  of  service. 
Screen  scores  were  developed  at  CNA. 

062-062     Matched  SCAT  Flag: 
1  =  yes 

0  =  no 

SCAT   =   System   Consolodation   for 
Accessions  and  Trainees 

063-063     Recruit  Training  Command  Flag: 

1  =  completed  Boot  Camp 

0  =  did  not  complete  Boot  Camp 

064-064     Primary  Dependents: 

0  =  no  primary  dependents 

1  =  spouse  only 

2  =  spouse  and  1  chi Id 

9  =  spouse  and  8  children  or  more 
A  =  no  spouse  and  1  child 

H  =  no  spouse  and  8  children  or  more 

065-068  Present  Rating 

069-069  Present  Paygrade 

070-075  Active  Duty  Service  Date 

076-079  Pay  Entry  Base  Date 

080-083  End  of  Active  Obligated  Service 

084-087  Year-Month  NITRAS  course  completed 

088-091  NITRAS  course  code 

092-093     NITRAS  student  action  code 

NITRAS  =  Navy  Integrated  Training 
System 

094-096     Age  of  recruit 

097-097     Left  Navy  flag: 

1  =  person  left  the  Navy 

0  =  person  did  not  leave  the  Navy 
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ATEAOS  098-098     EAOS  Flag: 

1  =  person  left  at  EAOS 
0  =  otherwise 

MOSIN  099-101     Months  in  the  Navy: 

Given  a  person  left  the  Navy,  this  is 
the  number  of  months  on  active  duty. 
If  the  person  is  still  on  active 
duty,  the  field  is  coded  '0  . 

COMPS  102-104  Composite  test  score 

RATEF  105-108  Final  Rating 

BLANK  109-109  Blank  column 

E2  110-112  Months  in  paygrade  E2 

E3  113-115  Months  in  paygrade  E3 

E4  116-118  Months  in  paygrade  E4 

E5  119-121  Months  in  paygrade  E5 

INITRAT  122-125  Initial  Rating 

RATCHG  126-127  Number  of  Rating  Changes 

DATE  128-130  Month-Year  of  change 

RATING  131-134  Rating  Code 

DATE  135-137  Month-Year  of  change 

RATING  138-141  Rating  Code 

DATE  142-144  Month-Year  of  change 

RATING  145-148  Rating  Code 

PAYCHG  149-150  Number  of  Paygrade  Changes 

DATE  151-154  Year-Month  of  change 

PAYGRADE  155-155  Paygrade  Code 

DATE  156-159  Year-Month  of  change 

PAYGRADE  160-160  Paygrade  Code 

DATE  161-164  Year-Month  of  change 

PAYGRADE  165-165  Paygrade  Code 

DATE  166-169  Year-Month  of  change 

PAYGRADE  170-170  Paygrade  Code 

DATE  171-174  Year-Month  of  change 

PAYGRADE  175-175  Paygrade  Code 

NECCHG  176-177  Number  of  NEC  changes 

DATE  178-180  Month-Year  of  change 

NEC  181-184  NEC  code 

DATE  185-187  Month-Year  of  change 
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APPENDIX  C 
PROGRAM  LISTING 


We  built  our  models  using  the  SAS  programming  language.  SAS  r 
numerical  computation,  statistical  results,  and  graphical  summaries.  SA; 
used  by  this  study  are  listed  in  the  following  order. 


>rovided  us 
!  programs 


Basic  Training: 
Attrition: 
Specialized  Training: 


Two  Factor  ANOVA  Model 


Two  Factor  ANOVA  Model 
Single  Factor  AXOVA  Model 
Non- Linear  Exponential  Model 
Simple  Linear  Regression  Model 
Simple  Linear  Regression  Model 
Single  Factor  ANOVA  Model 


BASIC  TRAINING 


OPTIONS  LINESIZE=80; 
DATA  MTGR; 

TITLE  'MONTHS  TO  GET  RATED' 

INPUT  I  M  R  $ 


LABEL  I 
LABEL  M 
LABEL  R 
LABEL  Y 
CARDS; 


Y; 

ID  NUMBER; 

MONTHS  TO  GET  RATED; 

RATING; 

YEAR; 


PROC  GLM   DATA=MTGR  /  P  CLI; 

ID  I; 

CLASS  R  Y* 

MODEL  M  ='R  Y  R*Y  /  P  CLI; 

MEANS  Y; 

MEANS  Y/TUKEY; 

OUTPUT  OUT  =  STATS   P  =  YHAT   R  =  RESID; 
PROC  PLOT  DATA  =  STATS; 

PLOT    M    *    Y    =     ' * '     ; 


Single  Factor  ANOVA  Model 

OPTIONS  LINESIZE=80; 
DATA  BTP; 

TITLE  'MONTHS  TO  GET  RATED"  ; 
INPUT  I  M  Y; 

LABEL  I  =  ID  NUMBER; 
LABEL  M  =  MONTHS  TO  GET  RATED; 
LABEL  Y  =  YEAR; 
CARDS; 

PROC  GLM   DATA=BTP; 

ID  I; 

CLASS  Y; 

MODEL  M  =  Y  /  P  CLI; 

MEANS  Y/TUKEY; 

OUTPUT  OUT  =  STATS   P  =  YHAT   R  =  RESID; 
PROC  PLOT  DATA  =  STATS; 

PLOT  M  *  Y; 

PLOT  YHAT  *  Y  =  ' * '  ; 

PLOT  RESID  *  Y  =  '*'  /  VREE  =  0  ; 

PLOT  RESID  *  YHAT  =  '*'  /  VREF  =  0; 
PROC  CHART  DATA  =  STATS; 

VBAR  RESID; 
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ATTRITION 

Non  Linear  Exponential  Model 

OPTIONS  LINESIZE=80; 
DATA  AR • 

TITLE  'ATTRITION  RATE     E(NT)  =  N* EXP ( -LAMBDA* T) 

INPUT  T  L  CL  NT  P  R  Y; 
N  =  XX; 

LABEL  T  =  TIME  IN  MONTHS; 

LABEL  L  =  LOSS; 

LABEL  CL  =  CUMULATIVE  LOSS; 

LABEL  NT  =  NUMBER  OF  SURVIVORS  AT  TIME  T; 

LABEL  P  =  PERCENT  OF  SURVIVORS  AT  TIME  T; 

LABEL  R  =  RATING; 

LABEL  Y  =  YEAR  GROUP; 
CARDS; 

PROC  NLIN  DATA=TAR; 

PARAMETERS  LAMBDA  =  .01; 

MODEL  NT  =  N*EXP( -LAMBDA*T) ; 

DER. LAMBDA  =  -N*T*EXP( -LAMBDA*T ) ; 

OUTPUT  OUT  =  STATS     P  =  NTHAT     R  =  RES ID; 
PROC  PLOT  DATA  =  STATS; 

PLOT  NT*T  =  'A'     NTHAT*T  =  'P'  /  OVERLAY; 

PLOT  RES  ID  *  T  /  VREF  =  0; 

PLOT  RES  ID  *  NTHAT  /  VREF  =  0; 
PROC  CHART  DATA  =  STATS; 

VBAR  RES ID; 

Simple  Linear  Regression  Model 

OPTIONS  LINESIZE=80; 
DATA  AR • 

TITLE  'ATTRITION  RATES'  ; 
INPUT  A  R  Y  X; 

LABEL  A  =  ATTRITION  RATE; 
LABEL  R  =  RATING; 
LABEL  Y  =  YEAR  GROUP; 
LABEL  X  =  GROUP  NUMBER; 
CARDS; 

PROC    REG      DATA=AR; 

MODEL   A=X/DWPRCLI    CLM    INFLUENCE; 

OUTPUT  OUT=STATS   P=PRED   R=RESID 

COOKD=CD   H=HAT   RSTUDENT=RS; 
PROC  PLOT  DATA  =  STATS; 

PLOT  A*X; 

PLOT  PRED*X; 

PLOT  RESID*X  /  VREF  =  0; 

PLOT  RESID*PRED  /  VREF  =  0; 

PLOT  HAT*X  /  VREF  =  0; 

PLOT  RS*A  /  VREF  =  0; 

PLOT  CD*X  /  VREF  =  0 ; 
PROC  CHART; 

VBAR  RES ID; 
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SPECIALIZED  TRAINING 

Simple  Linear  Regression  Model 

OPTIONS  LINESIZE=80; 
DATA  NECAVG; 

TITLE  'NECS  PER  INDIVIDUAL'; 

INPUT  N  S  A  Y  X; 

LABEL  N  =  NUMBER  OF  NECS; 

LABEL  S  =  SIZE  OF  YEAR  GROUP; 

LABEL  A  =  AVERAGE  NUMBER  OF  NEC'S  PER  INDIVIDUAL; 

LABEL  Y  =  YEAR  GROUP; 

LABEL  X  =  SUBGROUP; 
CARDS; 

PROC  REG   DATA=TNECAVG; 

ID  X; 

MODEL  A  =  X  /  DW  P  R  CLI  CLM  INFLUENCE; 

OUTPUT  OUT=STATS   P=PRED   R=RESID 

COOKD=CD   H=HAT   RSTUDENT=RS; 
PROC  PLOT  DATA  =  STATS; 

PLOT  A*X; 

PLOT  PRED*X; 

PLOT  RESID*X  /  VREF  =  0; 

PLOT  RESID*PRED  /  VREF  =  0; 

PLOT  HAT*X  /  VREF  =  0; 

PLOT  RS*A  /  VREF  =  0; 

PLOT  CD*X  /  VREF  =  0; 
PROC  CHART; 

VBAR  RES ID; 

Single  Factor  Anova  Model 

OPTIONS  LINESIZE=80; 

DATA  TNEC; 

TITLE  'NECS  PER  YEAR  GROUP'; 

INPUT  I  M  N  Y  R; 
S  =  M  +  N; 

LABEL  I  =  ID  NUMBER; 

LABEL  M  =  SECOND  YEAR  NUMBER  OF  NECS; 

LABEL  N  =  THIRD  YEAR  NUMBER  OF  NECS; 

LABEL  Y  =  YEAR; 

LABEL  R  =  RATING; 
CARDS; 

PROC  GLM   DATA=TNEC; 

ID  I; 

CLASS  Y; 

MODEL  S  =  Y  /  P  CLI; 

MEANS  Y; 

MEANS  Y/TUKEY; 

OUTPUT  OUT  =  STATS   P  =  SHAT   R  =  SRESID; 
PROC  PLOT  DATA  =  STATS; 

PLOT  S  *  Y; 

PLOT  SHAT  *  Y; 

PLOT  SRESID  *    Y   /   VREF  =  0  ; 

PLOT  SRESID  *  SHAT  /  VREF  =  0; 
PROC  CHART  DATA  =  STATS; 

VBAR  SRESID; 
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APPENDIX  D 
DATA  VECTORS 

These  are  the  numerical  values  we  used  in  the  SAS  programs.    Numbers  used  in 
the  first  two  ANOVA  models  will  not  be  listed. 

ATTRITION 
Non-Linear  Regression  Data  Set 

AT  AW  AX 


00 

00 

00 

131 

1 

.000 

2 

77 

01 

06 

06 

125 

0 

,954 

2 

77 

02 

02 

08 

123 

0. 

,938 

2 

77 

03 

02 

10 

121 

0 

,923 

2 

77 

04 

01 

11 

120 

0 

,916 

Z 

77 

05 

01 

12 

119 

0 

,908 

2 

77 

06 

02 

14 

117 

0 

.893 

2 

77 

07 

01 

15 

116 

0 

,835 

2 

77 

08 

01 

16 

115 

0 

,877 

2 

77 

19  01  17  114  0.870  2  77 

20  01  18  113  0.862  2  77 


00 

00 

00 

173 

1 

,000 

2 

78 

01 

12 

12 

161 

0 

.930 

2 

78 

02 

05 

17 

156 

0 

.901 

2 

78 

05 

01 

18 

155 

0 

.895 

2 

78 

06 

01 

19 

154 

0 

.890 

2 

78 

09 

01 

20 

153 

0 

,884 

2 

78 

11 

01 

21 

152 

0 

.878 

2 

78 

12 

01 

22 

151 

0 

.872 

2 

78 

16 

01 

23 

150 

0 

.867 

2 

78 

17 

02 

25 

148 

0 

.855 

2 

78 

18 

01 

26 

147 

0 

.849 

2 

78 

20 

01 

27 

146 

0 

.843 

Z 

78 

21 

01 

28 

145 

0 

.838 

2 

78 

23 

02 

30 

143 

0 

.826 

z 

78 

24 

01 

31 

142 

0 

.820 

2 

78 

00 

00 

00 

330 

1 

.000 

2 

79 

01 

19 

19 

311 

0 

.942 

2 

79 

02 

19 

38 

292 

0 

.834 

2 

79 

04 

02 

40 

290 

0 

.878 

2 

79 

05 

02 

42 

288 

0 

.872 

2 

79 

06 

02 

44 

286 

0 

.866 

2 

79 

03 

01 

45 

285 

0 

.863 

2 

79 

09 

03 

48 

282 

0 

.854 

2 

79 

10 

01 

49 

281 

0 

.851 

2 

79 

11 

01 

50 

280 

0 

.848 

2 

79 

12 

02 

52 

278 

0 

.842 

2 

79 

13 

01 

53 

277 

0 

.83  9 

2 

79 

14 

02 

55 

275 

0 

.833 

2 

79 

15 

02 

57 

273 

0 

.827 

2 

79 

16 

01 

58 

272 

0 

.824 

2 

79 

22 

02 

60 

270 

0 

.818 

2 

79 

23 

01 

61 

269 

0 

.315 

Z 

79 

00  00  00  324  1.000  2  80 

01  10  10  314  0.969  2  80 

02  11  21  303  0.935  2  80 
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03 

02 

23 

301 

0.929 

Z 

80 

04 

02 

25 

299 

0.922 

z 

80 

05 

02 

27 

297 

0.916 

2 

80 

06 

01 

28 

296 

0.913 

2 

80 

07 

01 

29 

295 

0.910 

2 

80 

03 

01 

30 

294 

0.907 

2 

80 

09 

03 

33 

291 

0.898 

2 

80 

10 

03 

36 

288 

0.888 

2 

80 

11 

01 

37 

287 

0.885 

2 

80 

12 

03 

40 

284 

0.876 

2 

80 

14 

01 

41 

283 

0.873 

2 

80 

15 

01 

42 

282 

0.870 

2 

80 

16 

01 

43 

231 

0.867 

2 

80 

17 

01 

44 

280 

0.864 

2 

80 

21 

01 

45 

279 

0.861 

2 

80 

22 

02 

47 

277 

0.854 

2 

80 

23 

01 

48 

276 

0.851 

2 

80 

24 

01 

49 

275 

0.848 

2 

80 

00 

00 

00 

291 

1. 

.000 

1 

81 

00 

00 

00 

315 

1.000 

2 

81 

00 

00 

00 

051 

1 

,000 

3 

81 

01 

07 

07 

284 

0, 

.975 

1 

81 

01 

27 

27 

288 

0.914 

2 

81 

01 

03 

03 

048 

0 

,941 

3 

81 

02 

03 

10 

281 

0, 

.965 

1 

81 

02 

11 

38 

277 

0.879 

2 

81 

02 

02 

05 

046 

0 

,901 

3 

81 

03 

01 

11 

280 

0 

,962 

1 

81 

03 

04 

42 

273 

0.866 

2 

81 

03 

01 

06 

045 

0 

,882 

3 

81 

05 

01 

12 

279 

0 

.953 

1 

81 

04 

04 

46 

269 

0.853 

2 

81 

06 

02 

08 

043 

0 

,843 

3 

81 

11 

01 

13 

278 

0 

.955 

1 

81 

05 

02 

48 

267 

0.847 

2 

81 

08 

01 

09 

042 

0 

,823 

3 

81 

12 

02 

15 

276 

0. 

,943 

1 

81 

06 

01 

49 

266 

0.844 

2 

81 

11 

01 

10 

041 

0 

,803 

3 

81 

14 

01 

16 

275 

0. 

,945 

1 

81 

07 

04 

53 

262 

0.831 

2 

81 

16 

01 

11 

040 

0 

,784 

Z 

81 

15 

01 

17 

274 

0 

,941 

1 

81 

08 

02 

55 

260 

0.825 

2 

81 

18 

01 

12 

039 

0, 

,  7o4 

Z 

81 

17 

02 

19 

272 

0. 

,934 

1 

81 

09 

02 

57 

258 

0.819 

2 

81 

19 

01 

13 

038 

0 

,745 

Z 

81 

18 

02 

21 

270 

0 

.927 

1 

81 

10 

01 

58 

257 

0.815 

2 

81 

19 

01 

22 

269 

0, 

,924 

1 

81 

13 

01 

59 

256 

0.812 

2 

81 

21 

01 

23 

268 

0 

,920 

1 

81 

14 

02 

61 

254 

0.806 

2 

81 

22 

01 

24 

267 

0, 

,917 

1 

81 

15 

01 

62 

253 

0.803 

2 

81 

24 

01 

25 

266 

0. 

,914 

1 

81 

17 
18 
21 
22 
24 

01 
01 
01 
02 
01 

63 
64 
65 
67 
68 

252 
251 
250 
248 
247 

0.799 
0.796 
0.793 
0.787 
0.784 

2 
2 
2 
2 
2 

81 
81 
81 
81 
81 

00 

00 

00 

664 

1. 

,000 

1 

82 

00 

00 

00 

501 

1.000 

2 

82 

00 

00 

00 

177 

1 

,000 

Z 

82 

01 

15 

15 

649 

0 

,977 

1 

82 

01 

45 

45 

456 

0.910 

2 

82 

01 

03 

03 

174 

0 

.983 

z 

82 

02 

12 

27 

637 

0. 

,959 

1 

82 

02 

22 

67 

434 

0.866 

2 

82 

02 

02 

05 

172 

0 

,971 

3 

82 

03 

07 

34 

630 

0 

,948 

1 

82 

03 

03 

70 

431 

0.860 

2 

82 

03 

01 

06 

171 

0 

,966 

3 

32 

04 

01 

35 

629 

0 

,947 

1 

82 

04 

03 

73 

428 

0.854 

2 

82 

07 

01 

07 

170 

0 

,960 

Z 

82 

05 

02 

37 

627 

0 

,944 

1 

82 

05 

02 

75 

426 

0.850 

2 

82 

09 

01 

08 

169 

0 

,954 

Z 

82 

06 

03 

40 

624 

0 

,939 

1 

82 

07 

03 

78 

423 
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